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Abstract 

This paper deals with uncertain dynamical systems in which pre- 
dictions about the future state of a system are assessed by so called 
pseudomeasures. Two special cases are stochastic dynamical systems, 
where the pseudomeasure is the conventional probability measure, and 
fuzzy dynamical systems in which the pseudomeasure is a so called pos- 
sibility measure. 

New results about possibilistic systems and their relation to deter- 
ministic and to stochastic systems are derived by using idempotent pseu- 
dolinear algebra. 

By expressing large deviation estimates for stochastic perturbations 
in terms of possibility measures, we obtain a new interpretation of the 
Freidlin-Wentzell quasipotentials for stochastic perturbations of dynam- 
ical systems as invariant possibility densities. 
PACS numbers: 02.10.Gd, 07.05.Mh, 02.30.Wd, 05.40. +j 



2 



I Introduction 

Modelling natural processes by deterministic dynamical systems requires usu- 
ally simplifying approximations and assumptions. It is reasonable to look for 
methods which take into account the uncertainties caused by these inevitable 
simplifications. 

The historically oldest method is probability theory: If the uncertainties can 
be interpreted as the cumulative effect of a large number of independent small 
perturbations the rules of probability theory can be applied to estimate how 
often in a large sample of identical processes an actually occuring event would 
be close to the deterministically predicted event within certain bounds. The 
arguably most successful results of this strategy can be found in statistical 
mechanics. 

About 30 years ago, L. Zadeh U introduced a different approach to uncertain- 
ties: The theory of fuzzy sets. This theory has become increasingly popular as 
a successful tool for modelling uncertainties in various applications, notably in 
engineering (process control) and information technology (expert systems). 

The advantages of this approach when compared to probability theory are a 
higher flexibility of rules, an intuitive appeal, and some computational merits. 
These advantages are favourable for the handling of uncertainties in single 
events for which no statistical information is available, and for quantifying 
semantic statements about uncertainties. On the other hand there are bitter 
controversies about the epistemological justification of fuzzy methods. But 
although in some applications of fuzzy tools a hint of arbitrariness can still 
be detected, there are now well developed systematic ways of using the fuzzy 
approach, in particular the branch called possibility theory ||. 

It is not the intention of this article to explain or to justify the fuzzy approach, 
and there can be little doubt that it will never reach the same importance in 
theoretical physics as the probabilistic approach. But the existence of non- 
probabilistic concepts of uncertainty suggests that some questions that are 
asked about the effect of random perturbations on dynamical systems can be 
posed in a wider framework. Such questions belong often to one of the following 
classes: 

• Stability questions: Which of the features of a deterministic dynamical 
system are robust to small uncertainties? 

• Asymptotics of weak perturbations: Are there approximations for the 
deviations of an uncertain system from a deterministic system when the 
uncertainties are small? 

It is obvious that it makes sense to try to answer questions of the first type in 
a way which is as independent of a special model of uncertainty as possible. 
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Here, the results of Section |V| about the sets of states which dominate the long- 
term behaviour in an uncertain system are an interesting example. It will turn 
out that these sets are roughly identical to the chain recurrent sets |§ of the 
underlying deterministic system — independent of whether the uncertainties 
are modelled according to probability theory or according to possibility theory. 

On the other hand, questions of the second type do not ask for such gen- 
erality and model independence, as they usually refer to concrete situations. 
There seems to come little direct motivation from concrete physical problems 
to study possibilistic systems. However, we will show in Section [Vl] that pos- 
sibilistic systems can be used as a tool for finding approximate results about 
probabilistic systems and for solving variational problems. This insight forms 
a new motivation for theoretical physicists to look at possibilistic methods, 
and it bridges the gulf between probability theory and possibility theory. We 
mention already here that the most interesting link between probability the- 
ory and possibility theory is established by the much used estimates of large 
deviation type @, [5[ . In the context of dynamical systems this means that the 
so called quasipotentials or nonequilibrium potentials || |7|, §, |9j — a standard 
tool for studying stochastic perturbations — have a natural interpretation in 
the context of possibility theory. 

From the start we will introduce the non-probabilistic approaches to uncer- 
tainty not as a contrast but as a generalisation of the probabilistic approach. 
This is made easy by following not Zadeh's original way of modifying set the- 
ory (or logic), but by generalising the notions of measure and integral. Several 



authors have suggested such generalisations (e.g. IJTy, 11, |12[); we follow most 



closely Sugeno's work [JTTJ on "pseudo-additive measures". Our definitions 
differ slightly from Sugeno's in that we stress the algebraic properties of the 
"pseudo-additive integrals" . Since we introduce several generalisations of well- 
known mathematical objects we find it convenient to use the prefix "pseudo" 
to name the generalised versions. 

The algebraic properties of pseudointegrals bring us to another essential ingre- 
dient of this paper: Pseudolinear algebra. Over the last years there have been 
increasingly many applications of this interesting branch of mathematics (e.g. 
in finite automata |13|, morphology neural networks fll4jl , image processing 



Wjj , and one dimensional crystallographic models |T6|), indicating that it is 



worth while to advocate a wider spread of its ideas. A particularly well studied 
special case of pseudolinear algebra is the so called idempotent algebra which 
has its roots in optimisation theory. There seem to be several authors which 
have discovered its main results independently (for reviews see ^7\, [IB], [TP], |2D|). 



While most of the existing results in idempotent pseudolinear algebra refer to 
finite dimensional situations, we need infinite dimensional versions. Section 



IV contains our results on the pseudolinear eigenvalue problem on a func- 



tion space. Recently some similar and some stronger results became available 
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through |2(J , and some of the results have been known in the language of infi- 
nite horizon problems in optimisation theory for a while ||21|| . Nevertheless, a 



complete presentation of our approach is important here, not only for the sake 
of self-consistency of this paper but because our approach — unlike |20 



con- 



centrates on the structure of the eigenf unctions which will have the meaning 
of invariant possibility densities or quasipotentials in our applications. 

The material in this paper is organised as follows: 

Section introduces the definitions of semirings, pseudomeasures, and pseu- 
dointegrals. In Section JT| we explain how these concepts can be used to model 
uncertain dynamical systems and show that invariant pseudodensities for the 
characterisation of their long-term behaviour fulfill a pseudolinear eigenvalue 
equation. Section [TV] contains the solution of this eigenvalue problem under 
the algebraic assumption of idempotency of pseudoaddition. This assumption 
is fulfilled if the pseudomeasures are possibility measures. Section [V] is devoted 
to the study of links between possibilistic and deterministic systems, and we 
will show a connection between solutions of the pseudolinear eigenvalue prob- 
lem and chain recurrent sets of deterministic systems. Finally, in Section |V| 
we will use possibilistic systems to derive results about stochastic systems. In 
particular we will formulate the so called large deviation property in terms of 
possibility measures and explain the connection to quasipotentials. 



II Pseudomeasures and pseudointegrals 
over semirings 

Let (X, A) be a measurable space (i.e. A is a a-algebra of subsets of X). A 
pseudomeasure is a certain set function P : A — > E which is introduced in 
order to assess the guess that an element of X belongs to A £ A at P(A). We 
give some structure to the evaluation set E which makes it suitable for such 
assessments. 

Definition II. 1 An ordered commutative monoid is a quadruple (E,<,+,6) 
with 

(i) (E,<) is a partially ordered set (i.e. there is a reflexive, transitive, and 
antisymmetric relation < on E). 

(ii) (E, +) is a commutative semigroup (i.e. + is an associative and commu- 
tative binary operation on E). The operation + is called pseudoaddition. 

(Hi) 6 is an identity element of E under + (i.e. a+6 = a for all a £ E). 

(iv) + is a monotone operation on (E,<) (i.e. a < b for a,b £ E implies 
a+c < b+c for all c £ E). 
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(E, <, + , 6) is called positively ordered commutative monoid if in addition 6 < 
a for all a £ E. 

For questions of convergence it is most convenient to deal with a special type 
of partially ordered sets: 

Definition II. 2 A partially ordered set (E, <) in which each subset G C E 
has a least upper bound sup G as well as a greatest lower bound inf G is called 
a complete lattice. 

A partially ordered set (E, <) in which for each pair (a,b) £ E x E either 
a < b or b < a (i.e., a and b are comparable) is called totally ordered. 



Example II. 3 Simple but important examples of complete lattices are 

« I =[0,1], 

(ii) IE = EU {-oo,oo}, 

(iii) 1E+ = {a £ K : a > 0} U {oo}, 

(iv) IE" = {a £ H : a < 0} U {-oo} 

with the usual order relation < for real numbers. These examples are all totally 
ordered. 

For every complete lattice (E,<), (E,<,+,0) with = inf E and a+b = 
sup{a, b} is a positively ordered commutative monoid. 

Two other examples for pseudoadditions are a+b = a + b on E = 1E + and 
a+b — a + b — ah on E — I. 

Pseudoadditions in positively ordered commutative monoids, especially for 
E = I, are called triangular conorms and have been studied in great detail in 



the context of probabilistic metric spaces [22 



Definition II. 4 The limit superior of a sequence (aj)j=i 5 2,... of elements of a 
complete lattice is defined as 

limaj = inf sup Oj, 

the limit inferior as 

lim a,i = sup inf a $ . 

j 

If lim a,i = lim a, = a* then (a^) is called order convergent to the limit a* = 
lim cij . 

i 
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From now on we assume that the pseudoaddition is continuous: 
lim(aj+6j) = lim aj+ lim 6j 

i i i 

Definition II. 5 Let (E,<) be a complete lattice, (E, <,+, 0) a positively or- 
dered commutative monoid, and (X, A) a measurable space. A pseudomeasure 
is a set function P : A — > E with the properties 

(i) p(0) = 6, 

(ii) P (Ui Ai) = Si-P(A) /or every family (Ai) of pairwise disjoint Ai G .4. 
i/ere, £/ie obvious symbol f or pseudosums was used. 

Sets of pseudomeasure 6 are called P-nullsets. Statements which are true for 
all x G X — O with O a P-nullset are said to hold (P-) almost everywhere. 

Having defined a generalisation of measures, we next generalise integrals. 
Again we are led by the aim to retain some of the algebraic properties of 
the conventional integral. Therefore we introduce a further operation on E. 

Definition II. 6 A positively ordered commutative semiring is the collection 
(E, <, +, 0, : , 1) where 0^1 and 

(i) (E, <, +, 6) is a positively ordered commutative monoid. 

(ii) (E, <, : , i) is an ordered commutative monoid. The operation : is called 
pseudomultiplication. 

(Hi) (a+b) : c = a : c+b : c for all a,b,c G E. 

(iv) &-a = for all a G E. 

If in addition a : b = =3- a = or b = then the semiring is called entire. 

If a-c — b"-c =^ a — b for all a,b,c G E, c ^ then the semiring is called 
cancellative. 

In the following we assume continuity of the pseudomultiplication: 
\im.(af-bi) = lim a^lim 6j. 

i i i 

From now on, we deal only with entire semirings. 
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Example II. 7 For every complete lattice E, (E, <, +, 6, : , 1) with 6 = inf E, 
1 = sup E, a+b = sup{a,6}, and a-b = inf{a, b} is an ordered commutative 
semiring. 

Some examples for semirings involving the lattices of Example [IL3| are: 



(i) E = E+ 6 = 0, i = 1, a+b = a + b, a-b = ab 

(ii) E = I, 6 = 0, i = 1, a+b = max{a, b}, a-b = ab 

(iii) E — I, = 0, 1 = 1, a+b = max{a, b}, a"-b = min{a, b} 

(iv) E = IE", 6 = — oo, 1 = 0, a+b = max{a, b}, a"b = a + b 

There is a close relation between Examples |(ii)| and pv)| : Because of 
exp(max{a, b}) = max{exp(a), exp(6)}, exp(a+&) = exp(a) exp(6), exp(— oo) = 
0, and exp(0) = 1, the exponential function is a semiring morphism between 
those examples. 



All the Examples [Tj] to |(iv)| are entire semirings. Examples [I], |(ii) , and [iv) 
are cancellative. 

Pseudomultiplications with 1 = sup E, especially for E = I (as in Examples 
|(ii)| and |(iii)|) , are called triangular norms, and the semiring is then called 
absorptive. 



Definition II. 8 A function f : X —> E is called measurable if for every a G E 
the set {ifl: f(x) < a} is in A. 

The space of measurable functions f : X — » E is denoted by Ai. 

The definition of pseudointegrals of measurable functions is strictly analogous 
to the definition of conventional integrals: 

Definition II. 9 For A C X define the characteristic function 
f 1 ifx G A 

A simple function is a function h : X — >• E which can be written as 

- — ~ n 

h (%) = J2 i=1 h i : XA t 

with disjoint A4 G A, hi G E, i = 1, . . . , n (n G 1NJ. We denote the space of 
measurable simple functions by H.. 

For h G B G A, and a pseudomeasure P we define 

- — - n 

I(h;B;P) =J2 l= hfP(A i n B). 
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Definition 11.10 The pseudointegral of a measurable function f : X — > E 
over a set B G A with respect to a pseudomeasure P is defined by 

f f{x)"-P{dx) = sup{/(/i; B-P) :heH,h< /}. 
Here, the notation h < f means that h(x) < f(x) for all x G X . 

Example 11.11 In many situations there is a particularly simple reference 
pseudomeasure Q with respect to which most pseudointegrals are calculated, 
in which case we use the following abbreviated notation: 

7 f{x)-Q{dx)=l f(x)-dx. 

In the case E = IE + , + = +,6 = 0, and X = IR™ the standard reference 
measure Q is the Lebesgue measure. 

In the case a+b = sup{a, b} we use 
Q{A) = 1 for all A G A- {0}. 
Then we obtain 

/ f(x)"dx = sup{/(:r) : x G A}. 
J A 

The first part of the following proposition is obvious, and the second part can 
be proved like the theorem of monotone convergence for conventional integrals: 

Proposition 11.12 (i) If f < g for measurable f, g, then f x f(xf-P(dx) < 
] x g(x)-P(dx). 

(ii) Let {f} be a sequence of measurable functions with 
/i</ 2 <.... 

Then 

lim / fAxY-Pidx) = / lim fi(x) : P(dx). 
* J x J x * 

Pseudointegrals are pseudolinear. Pseudolinearity is a generalisation of lin- 
earity which involves the concept of semimodules as a generalisation of vec- 
torspaces. 
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Definition 11.13 A positively ordered semimodule over a positively ordered 
semiring (E, <, +, 0, : , 1) is a positively ordered commutative monoid {V, <, 
+, 0) for which an external operation, : : E x V — > V , called pseudomultiplica- 
tion by a scalar, is defined and has the following properties: 

(i) (a : b) : v = a : (b : v) 

(ii) (a+b) : v = (a : v)+(b : v) 
(Hi) a : (v+w) = (a : v) + (a : w) 
(iv) &v = 6 

(v) Vv = v 

(vi) a < b =3- a : v < b : v 
(vii) v < w =3- a : v < a : w 

where a,b G E and v, w G V . 

Note that in this definition each of the symbols +, : , and has two different 
meanings which, however, can clearly be distinguished by the context in which 
the symbols are used. 

Special cases of semimodules are modules, where pseudoaddition is invertible, 
and vectorspaces, where additionally pseudomultiplication is invertible for non- 
elements. 

Definition 11.14 Let V and W be semimodules over a semiring E. A map 
H : V — > W is called a semimodule morphism or a pseudolinear map if 

(i) H(v+w) = H(v)+H(w) 

(ii) H{a-v) = a-H{v) 

for all v, w G V and a G E. 

Pseudolinearity of pseudointegration is expressed in the following obvious pro- 
position. 

Proposition 11.15 {M,<,+,6) with 
(f+g)(x) = f(x)+g(x), 

6(x) = o, 
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(a-f){x) = a-f(x) 



for all f, g G M., x G X , and a G E, and < defined as in Definition \[LTC is a 
positively ordered semimodule over (E, <. +, 0, : , 1). 

Pseudointegration defines a semimodule morphism 
I:M -> E 



f h- / f(x)-P(dx) 

J X 

Measurable functions can be used to define new pseudomeasures via pseudoin- 
tegrals. 

Proposition 11.16 If f G M., the set function Pf : A — ► E defined by 
Pf(A)= [ f(x)-P{dx) 

J A 

is a pseudomeasure. 

The function / is then called the pseudodensity of Pf with respect to P, and 
Pf is called absolutely continuous with respect to P. 

If Pf is not absolutely continuous with respect to P there is no pseudodensity 
as a measurable function, but it may be defined as a distribution. 



Ill Uncertain dynamical systems 

defined by transition pseudomeasures 

The tool of pseudomeasures makes it possible to define a quite general concept 
of uncertain dynamical systems with discrete time: 

Definition III.l An uncertain dynamical system with discrete time on a mea- 
surable phase space (X, A) is defined by a family (P x )xex of pseudomeasures 
on X with values in a positively ordered commutative semiring (E, <, +, 0, : , 1) . 

The system is called normal if P X {X) = 1 for all x G X. 



Remark III. 2 The pseudomeasures P x are interpreted as one-step transition 
pseudomeasures: If at time t the system is in a state x then the guess that at 
time t + 1 the system will be in a state in A G A is assessed at P X (A). 
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This definition includes deterministic discrete-time systems, usually defined by 
a map F : X —>■ X, as a special case, namely the case P x = SpM. Here, 8 X is 
the Dirac pseudo measure, defined by 



1 if x e A 
6 ifx^A 



Definition III. 3 For N G IN £/ie N-step transition pseudomeasure from x G 
X to A G A is defined by the following recursion formula: 

PW{A)=1 P y {A)-Pl N - l \dy). 



Remark III. 4 Pseudoaddition decides about how one-step transitions to uni- 
ons of sets are assessed and is therefore related to a generalised logical "or" . 

Pseudomultiplication comes into play when evaluating multi-step transitions. 
It is related to a generalised "and" . For example, the two-step transition mea- 
sure is obtained by pseudointegrating over all intermediate points the pseudo- 
product of the assessment of doing first one step to the intermediate point and 
then one step from there to the final set. 



Example III. 5 The best-known example of an uncertain dynamical systems 
is a stochastic dynamical system. In this case, E = IE + , + = +, : = -, = 0, 
1 = 1 — like in Example |H.7Ki) — and the transition pseudomeasures are tran- 



sition probabilities. Stochastic systems have been used extremely successfully 
for modelling uncertainties. This is especially true in all situations where, at 
least in principle, the frequencies of certain transitions can be observed at a 
large number of identical copies of the system. 

But there are situations where other rules of assessing uncertainties can be 
more useful. Here is an example: Assume that changing a system from state 
x into state y costs an amount —p(x, y) where p(x, y) G IE - (we count the 
costs as negative gains). We do not know who runs the system, so we cannot 
predict its future with certainty, but we assume that whoever runs the system 
will try to minimise the costs. So a reasonable assessment of the guess that 
the system is in a state in A at time t + 1 after being in state x at time t is 

P X (A) = sup{p(x,y) :yeA}, 

and a guess for being in A at time t + 2 would be assessed at 

P [ X 2 \A) = sup{p(x,y)+p(y,z) :yeX,zeA}. 
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This means that for this example we would choose E — IE , + = sup, • = +, 
= — oo, and 1 = — like in Example |II.7|(iv)| . 



This example shows that the choice + = sup is typical for systems which can 
be formulated as optimisation problems. 

In the context of fuzzy set theory the choice + = sup is often denoted by 
the adjective "possibilistic" . For instance, the pseudomeasures for that choice 
are called possibility measures. They offer a more diverse assessment of the 
possibility of events than a strict Boolean classification of states into possible 
and impossible states. The Boolean case is realised by the semiring ({0, 1}, 
<, sup, 0, inf, 1). Replacing the evaluation set {0, 1} by the unit interval /, one 
can try to quantify colloquial expressions like "nearly impossible" or "maybe 
possible" . 

Definition III. 6 A pseudomeasure S* is called invariant pseudomeasure of 
the uncertain system (P x ) if for all A e A 



S*(A)=[ P y {A)-S*{dy). 

J X 



Remark III. 7 Invariant pseudomeasures of uncertain systems are important 
for their long-term behaviour. If we assess the presumable state of a system 
at time t on the basis of a pseudomeasure S t then the pseudomeasure St+i, 
defined by 



S t+ i(A)=[ P y (A)-S t (dy) 

J X 



for A e A, gives the assessment at time t+1. 

Therefore invariant pseudomeasures are fixed points of the dynamics of as- 
sessments, and depending on their stability properties they may characterise 
the importance of subsets of the state space for the presumable long-term 
behaviour of the uncertain system. 

Normality of a system guarantees that S t+ i(X) = S t (X), indicating that the 
system is closed. 

It is often convenient to work with pseudodensities instead of pseudomeasures. 
Definition III. 8 Let Q be a standard reference pseudomeasure (see Example 



[Li]]) . If the transition pseudomeasures P x have pseudodensities p(x, ■), i. e. 
P X (A) = / p(x,y)^dy 

J A 

then these pseudodensities are called transition pseudodensities of the uncertain 
dynamical system. 
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In terms of transition pseudodensities, normality of the system means 

/ P(x,y) : dy = i 

J X 

for all x E X. 

Definition III. 9 An uncertain dynamical system with transition pseudoden- 
sities p(x, y) is called deterministically motivated if there is a map F : X — > X 
such that p(x, y) < p(x, F(x)) for all x, y G X and p(x, y) = p(x, F(x)) only if 
V = F(x). 



In such a system a transition from x to F(x) is assessed at the highest value 
among all transitions so that this case models what happens to the determin- 
istic system given by F if it is perturbed by uncertainties. 



Proposition III. 10 If an uncertain system has transition pseudodensities 
p(x, y) and if there is a function s G M. which solves for ally G X the equation 



Kv) 



s(x) : p(x, y) : dx 



x 



then Pg (see Proposition \II. 1 6| for the notation) is an invariant pseudomeasure. 
s is called invariant pseudodensity. 



The dynamics of pseudomeasures described in Remark \III. 9| reads on the level 
of pseudodensities as follows: 



s t (x) : p(x,y) : dx. 



x 



Definition III. 11 A measurable function k : X x X —>■ E defines a pseudo- 
linear operator Ok on M. by 

(O k f)(x)=l k(x,y)-f(y)-dy. 

The function k is called the pseudointegral kernel of Ok- 
The transposed operator O^ is defined by 



(0* k f)(x)= [ f(y)-k(y,x)-dy. 
J x 



14 



Corollary III. 12 In terms of the newly introduced operators, the equations 
in Proposition \III. 1 (\ read as follows: 



s t +i = Op s t 

and 



op. 



Generalising a further concept of linear algebra, we can say the last equation 
means that the invariant pseudodensity s is an eigenfunction of the operator 
Op with eigenvalue 1. 

Definition III. 13 Let V be a semimodule over a commutative semiring E 
and H : V — > V a pseudolinear map. If there is a v G V — {0} and an a G E 
such that 

H{v) = a-v 

then a is called an eigenvalue of H , and v is called an eigenelement correspond- 
ing to that eigenvalue. The set of eigenelements corresponding to a together 
with G V is denoted by V a . 



Proposition III. 14 The space V a is a sub- semimodule ofV. 

Thus, the search for invariant pseudodensities of uncertain systems is an eigen- 
value-eigenfunction problem (or eigenproblem for short) on a function space 
with the structure of a semimodule. 

The special case of a stochastic system leads to a classical eigenproblem on a 
vector space, and this is the situation which has been studied most. 

It is too much to expect that a lot can be said about the general eigenproblem, 
but the vector space case is not the only one which can be analysed in great 
detail. The following section deals with the case of idempotent pseudoaddition, 
which is in some aspects even simpler than the vector space case. 



IV The eigenproblem for pseudointegral 
operators on idempotent semimodules 

In order to construct eigenfunctions of pseudointegral operators on semimod- 
ules it is useful to introduce iterated kernels and transitive closures: 
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Definition IV. 1 Let k(x,y) = k\{x,y) be a pseudointegral kernel. The iter- 
ated kernels are then defined for N > 1 by 

k N+ i(x,y) = k N (x,zY-k(z,yY-dz. 

J x 

In the case k(x,y) = p(x,y) they are called N-step transition pseudodensities. 
The transitive closure of the kernel is 

- — - oo 

T k (x,y) = J2 N=1 k N (x,y). 



Definition IV. 2 A point a G X is called a basis point for a kernel k(x, y) if 
there is a (not necessarily unique) c(a) G E, c(a) ^ 0, such that 

c(a) : Tk(a, a) = c(a) : (Tk(a, a)+<5(a, a)) 

where S(y, x) is the pseudodensity of the Dirac pseudomeasure 5 X introduced in 
Remark \III. 4 

The set of all basis points for k(x, y) is denoted by B^. 



Proposition IV. 3 Let k(x, y) be a pseudointegral kernel. Then for every 
a G Bk and c(a) fulfilling the defining property of B^, the function ^k,a(x) = 
c(a) : Tk(x,a) is an eigenfunction of Ok and the function &k,a(x) = c(a) : Tk(a,x) 
is an eigenfunction of 01, both with eigenvalue 1. 

Proof 

From 

T k (x,a)= / k(x,y)'(T k (y,a)+6(y,a))'dy 
J x 

we obtain by pseudomultiplying both sides by c(a) 



J X 



The statement about $fc jQ can be proved analogously □ 

Proposition [IV. 3| is obviously not useful in the conventional vector space case, 
but it is the key to the eigenproblem in so called idempotent semimodules. 
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Definition IV. 4 A semimodule V is called idempotent if the pseudoaddition 
on the underlying semiring E is idempotent, i. e., 

a+a = a for all a G E. 



Remark IV. 5 In a positively ordered monoid E there is only one operation 
which qualifies as an idempotent pseudoaddition: We know that for a,b E E, 
a < a+b and b < a+b. Now assume c G E is another upper bound of a and b: 
a < c and b < c. Then we have a+b < c+c = c, showing that a+b = sup{a, b}. 
Consequently, the standard pseudointegral of a function is its supremum (cf. 
Example |IL11| ), and the Dirac pseudodensity S(a,a) appearing in Definition 
|IV.2| is equal to 1. 

Thus, the case of idempotent semimodules is what we are interested in when 
we study the possibilistic systems of Example [III.5 . 



Remark IV. 6 In the case of idempotent semimodules the condition for a G X 
being a basis point has an especially simple form if k(x, y) is bounded above by 
1. Since T k {x,y) is then bounded above by 1, too, the condition in Definition 



IV. | can be reduced to 
c(a)"-T k (a, a) = c(o). 

In a cancellative semiring this is obviously equivalent to 
T k (a,a) = i. 



Definition IV. 7 The set of normal basis points for a kernel k(x, y) is defined 
as 

R k = {x G X : T k (x, x) = i}. 

R k is a subset of B k . For k bounded by 1 in a cancellative semiring we know 
B k = Rk, but in the noncancellative case this is generally not true. 

Example IV. 8 In the case d-b = inf{a, b} it is easy to see that Bk = X. 
For every a G X the condition of Definition [IV.2| can be fulfilled with c(a) = 
T k (a,a). 



Nevertheless, for kernels bounded by 1 the normal basis points have a special 
importance in any case: 
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Remark IV. 9 The eigenfunctions from Proposition |1V.3| have the property 
I x^k,a(x) : dx = 1 and / x $k,a(%) : dx = 1 if and only if c(a) — 1 so that 
a G Rk- This follows from the fact that ^ (x) < c(a) = ^/.^(a) which means 
Lr^fc,^)^ = c(a). 

Next, we study the case that f4 contains more than one point and the relation 
between the different eigenfunctions that can then be constructed as described 
in Proposition [IV. 3. 



Definition IV. 10 Two normal basis points a,b G Rk are called equivalent 
a~ k b if 

T k (a,by-T k (b,a) = 1. 

Since the relation ~fc is an equivalence relation on Rk, every normal basis point 
a G Rk is a representative of an equivalence class, which is denoted by [a]k- 



Proposition IV. 11 // a ~& b for a,b G Rk then 
<$> k ,a( x ) = T k (a,by$ ktb (x) 

and 

* fc ,a(x) =T fc (6,o)^ fc>6 (x). 
Proof 

We show the first statement; the second follows analogously. 
We have 



/ - — ~ oo 
T k (a, y)7T k (y, x)"dy = J2 NM =i kN+M ^ 

— - oo 

On the other hand, from equivalence of a and b follows 

$fc,o(a;) = r fc (o,6)vT fc (6,a)-$ fci0 (x) 
< T fe (a, &)-<& fei6 (ar), 

which completes the proof. □ 

Proposition [1V.11| shows that the eigenfunctions constructed with equivalent 
normal basis points differ by a scalar factor only. 
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In order to derive more results about the eigenproblem we need more assump- 
tions about the space X and the kernel k. 

We assume in the following that the state space X is a compact metric space. 

It will turn out to be useful to have sort of a mean-value theorem for pseu- 
dointegrals, and this will dictate the regularity property we require of functions 
that appear as pseudointegrands. 

Definition IV. 12 A function f : X — > E is called upper semicontinuous if 
for all x G X and for all sequences (x,) with lim^oo xi = x 

lim/(xi) < f(x). 



Lemma IV. 13 Let X be a compact metric space and f : X — > E upper 
semicontinuous. Then under each one of the conditions 

(i) (E,<) is totally ordered, 

(ii) X is pathwise connected, 

there exists a y e X such that 



f(y) = / f(x) : dx. 
J x 

Proof 

Under the first condition the result follows like the well known result that 
upper semicontinuous real functions attain their suprema on compact sets. 

The second condition is sufficient since all elements in the image of a path in 
X under an upper semicontinuous function are comparable. □ 



From now on we make assumptions that guarantee that Lemma |IV.13| can 
be applied. In particular we assume that k is upper semicontinuous in both 
arguments (which implies that k^ and 7*. are upper semicontinuous) and that 
either all elements of E are comparable or all sets over which integrals are 
taken are pathwise connected. 

Proposition [IV. 3| can be used to show that 1 is an eigenvalue and to construct 
corresponding eigenfunctions only if is not empty. The following definition 
leads to a sufficient condition for existence of a normal basis point. 

Definition IV. 14 The kernel k is called definite if f x Tk(x, x^dx = 1. 



A direct consequence of Lemma |IV.13| is 
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Proposition IV. 15 Under the conditions of Lemma \l V.13{ and if k is definite 
then R k ^$. 

An important class of definite kernels are the normal kernels. 
Proposition IV. 16 A normal kernel k is bounded by 1 and definite. 
Proof 

Suppose that there are x, y G X such that k(x, y) is not less or equal 1. Then 
clearly f x k(x, z)"-dz > 1 in contradiction of the normality of k. So k(x, y) is 
bounded by 1 for all x, y G X . 

Since k is bounded by 1, so are the iterated kernels k^ (N G IN) and T k . 

Normality of k and Lemma |IV.13| imply that for every x G X there is a y G X 
such that k(x,y) = 1. Therefore we can find an infinite sequence (2^)1=1,2,... 
such that for every n G IN 

k n (xi, x n+ \) = 1. 

Since X is a compact metric space there is a subsequence (zj) = (x^) which 
converges to some z G X. For any m, n G IN with m < n we have 

Tk(z mi Zn) ^ ki n —i m (z mi z n ^j 1, 

and therefore T k (z m , z n ) = 1. 

Now fix m and let n — > 00. Upper semi continuity of T k in the second argument 
implies Tk(z m , z) > 1 and therefore Tk(z m , z) — 1. Finally, m — > 00 and upper 
semi continuity in the first argument gives T k (z, z) = 1 which shows, together 
with the upper bound 1 for T k , that k is definite. □ 

The next statement shows that eigenfunctions constructed like in Proposition 
[IV. 3| are pseudolinearly independent if they start from nonequivalent normal 
basis points. 

Proposition IV. 17 If K is a compact subset of R k , k a kernel bounded by 1, 
A an upper semicontinuous function on K , and for b G R k and all x G X 



®k,b( x ) = / A(a) : $ fc , a (x)-da, 

J K 



then b is equivalent to one of the elements of K. 
An analogous result holds for the functions ^k,a{x) 
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Proof 

We have 



1 = $ fc , 6 (&) = / \(a)-$ kia (b)-da. 

J K 



By Lemma |IV.13| there is an a G K such that 



1 = \{a)-$ k>a {b). 

Since A; is bounded by 1 we have $jt >a (x) < 1 for all o £ ^ and all x G X. 
Therefore the last equation shows that A (a) cannot be smaller than 1. But on 
the other hand we have 

1 > $fe,t(a) > A(a)-$ fc , a (a) = A(a) 

from which we can conclude A (a) = 1. But this means that 

^fc,o(6) = = 1 

which shows that b a. □ 



The next result shows that the construction of Proposition [IV .3| leads to all 
eigenfunctions of O k and with eigenvalue 1. 

Proposition IV. 18 Let k be a kernel bounded above by 1 and f a positive, 
upper semicontinuous eigenfunction of 01 with eigenvalue 1. Then 



fix) = / f(aYTJa,xYda 

J B k 

for all x G X . 

Similarly, for a positive, upper semicontinuous eigenfunction ip of O k with 
eigenvalue 1: 



ip(x) = I ^(a) : Tk(x,a) : da 



for all x G X . 



Proof 

If <£> is an eigenfunction of 01 with eigenvalue 1 it is an eigenfunction of Oj> 
with eigenvalue 1, too, and therefore: 

fix) — / fiaX-Tkia, xYda > / fiaYTJa, xYda 
J x J B k 
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for all xel. 

On the other hand we can use the eigenfunction property of ip and Lemma 
|1V.13| to construct a sequence (xj) such that for all i 

(pfa) = (p(x i+i yk(x i+ i,Xi) 

and therefore for j > i 

ip(xi) = ^{xjX'kixj.Xj--^ . . . ^k(x i+1 ,Xi) 

< ip{x j y-k^-i){xj,x i ) 

< ip(x j Y-T k (x j ,x i ). 

We start the construction of (xj) with x = x G X. The sequence (xj) has 
a convergent subsequence (x in ) with lim^oo Xi n = b G X, and we will show 
later that b G B k . Using the upper semi continuity of ip and T k we obtain in 
the limit n — ■> oo 

< lim^(x;J-T fc (x ln ,x) 

< ip{b)"-T k {b,x) 

< \ (p(a) : T k (a, x) : da 

which together with the opposite inequality establishes the statement about 
(p. 

The last step is to show that b G B k . We use one of the above inequalities: 

<f(xij < ip(x in )-T k (x in ,x im ) 

and let first n — > oo and then m — > oo. Using the upper semi continuity of 7*. 
we obtain 

\im(p(x in ) < \im(p(x in y-T k (b,b). 
But since T k is bounded above by 1 this means 

\im.tp(x in ) = \irmp(x in ) : T k (b,b). 
Therefore, for b the condition of Definition [lV.2| is fulfilled with c(b) = lirn</?(xj n ). 



□ 

Now we turn to the question of eigenvalues different from 1. 
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Definition IV. 19 A kernel k is called strongly connected if for all x,y G X, 

T k (x,y) > 6. 

Remark IV. 20 A kernel is certainly strongly connected if k(x,y) > for all 
x,y £ X , x y. A kernel is certainly not strongly connected if there are two 
nonempty sets X\,X 2 = X — X\ such that k(x,y) = for all x G X\ and 
y G X 2 , because for those x, y it is clear that T k (x, y) = 0. 



Proposition IV. 21 If k is strongly connected and if ijj is an upper semicon- 
tinuous eigenfunction of Ok (or 01) with eigenvalue A then A > andip{x) > 
for all x G X . 

Proof 

Assume that A = 0. Then the eigenvalue equation implies 

k(x,yy-i/j(y) = 6 

for all x, y G X. There must be at least one y* G X such that ip{y*) ^ 0. This 
means k(x, y*) = for all x G X in contradiction to the strong connectedness 
of k. Therefore A > 0. 

Assume now that X% = {x G X : if)(x) = 0} is not empty. X 2 = X — Xi also 
is not empty. The eigenvalue equation leads to 

k(x,yY-i(j(yy-dy = 6 

for all x 6 Ai, and this implies 

k(x,y) = 6 

for all x E Xi and y G X 2 . Remark [1V.20| shows that this is a contradiction to 



the strong connectedness of k; hence X\ must be empty. □ 



Proposition IV. 22 If k is a definite, strongly connected kernel with values 
in a cancellative semiring and A an eigenvalue of O k or Ol with an upper 
semicontinuous eigenfunction ifi then A = 1. 
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Proof 

First we show that A < 1 is not possible. 
The eigenvalue equation implies that 

\ty(x) > k(x,yY-ip(y) 

for all x, y e X. Consider a cyclic sequence y , yi, . . . , y^ = Vo- Repeated use 
of the above inequality shows 

k(yo,yi) : ■ ■ - : HyN-uyo) < A- ... - A < A 

where we used already the assumption A < 1 and the cancellation law, keeping 
in mind that ip is positive. 

This is true for any y G X and any cyclic sequence from y to y . Taking the 
supremum we find 

/ T k (y,y)-dy<X<i 
which contradicts the definiteness of k. 

Next we show that the assumption A > 1 leads to a contradiction, too. 
Construct a sequence (xj) such that 

X-ip(xi) = k(xi,x i+ iy-ip(x i+1 ). 

For n > m this leads to 

x*P(x m ) < T k (x m ,x n yi!(x n ). 

Concentrating on a convergent subsequence and using semicontinuity this im- 
plies 

1 < \<T k (b,b) 

for b an accumulation point of (xi). But this contradicts the definiteness of k 
again. □ 

Proposition IV. 23 If k is a strongly connected kernel with values in a semi- 
ring with multiplicative inverses and X an eigenvalue of O k or 0\ with an upper 
semicontinuous eigenfunction ip then the kernel X~ 1: k(x, y) is definite. 
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Proof 

The eigenvalue equation for O fc allows the construction of a sequence (xj) such 
that 

ifj(xi) = \~ 1: k(xi, x i+1 ) : ip(x i+1 ) . 
Introducing the abbreviation k(x,y) = \~ 1: k(x,y) we obtain 
ip(x m ) < T- k ( 

for m < n. For an accumulation point b of (xi) this means 

i<T~ k (b,b). 

On the other hand the eigenvalue equation can be used to show the estimate 



T^,(x, x) : dx < 1. 



Both results together lead to 



T^(x, x) : dx = 1. 



□ 



Remark IV. 24 Proposition [1V.23| shows that in the case of a strongly con- 



nected kernel and under the assumption of multiplicative invertibility the 
eigenvalue is unique, and the eigenfunctions can be found by studying a definite 
kernel. 

The fact that 



/ T^(x, x) : dx = 1 



leads to an interesting interpretation of the eigenvalue A, at least in a radicable 
semiring. A semiring E is called radicable if for every b e E and every n G IN 
the equation 

has a unique solution a 6 E, denoted by \/b. 
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The definiteness of k means that the supremum over all products 
Y[ i=1 X~ 1 "-k{xi-.i,Xi) over cyclic sequences with xq = xn is 1, or, if we call 



N 



-N 



a cycle mean, that A is the maximal cycle mean. 

We end this section with an example which shows that the cancellation law 
was essential for the derivation of uniqueness of the eigenvalue. Here is the 
extreme non-cancellative situation of Example |1V.8| again: 



Example IV. 25 In the case a-b = inf{a, b} every A G E, A ^ 0, is an eigen- 
value of every Ok and We know from Example [IV. 8| that 1 is an eigenvalue. 
So there exists a function such that 



k(x,y)~ip(yydy = i/j(x). 



But then X-ip fulfills for any A ^ 6 the eigenvalue equation 

k(x,y) : X4>(y) : dy = A-A-^(x), 

showing that A is an eigenvalue. 



A' 



V Connections between possibilistic 
and deterministic systems 

In Remark |III.7| and Corollary [111.121 we noted already that the eigenfunctions <p 
of a pseudointegral operator OJ on an idempotent semimodule with eigenvalue 
1, which we found in the previous section, are important for the long term 
behaviour of a possibilistic system with transition possibility density p: They 
are the fixed points of a dynamics of possibility densities. If at some moment 
the possibility of finding the system in the state x is assessed at if(x) for every 
x G X, then this assessment will not change in the future. 

Now it is interesting what will happen to initial possibility densities which are 
not eigenfunctions of Op — whether they converge to one of the stationary 
possibility densities. Unfortunately, such a convergence is not guaranteed in 
general, but only in special cases. 
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Proposition V.l Let a possibilistic system on a compact metric space X be 
described by a transition possibility density p(x, y) which is upper semicontin- 
uous and bounded above by 1. If p(a,a) = 1 for every a G Bp then in the 
dynamics of possibility densities, 

St+i — OpS t , 

starting from any initial possibility density s G M., s t converges pointwise to 
an invariant possibility density as t — > oo. 

Proof 

All we have to do is to show that liniAr^ 00 pAr(x, y) exists for all x, y G X since 
then 

Bm «,(„)= 7 fb(«^A(*,.)* 

t— >oo J t^OO 

and 

7 li m v )-<fc = 7 i^lim = fin 

We will show that for all x, y G X there is a basis point a E Bp such that 
lim p N (x, y) = Tp(x, a)-Tp(a, y). 

Consider an infinite sequence in X such that 

— n-1 

lim p^ar, y) = kp(i, £i) : II j=1 P(6 5 6+i) : /3(Cn, y)- 



There is a subsequence (£j fc ) converging to some a G X. We will show now 
that a is a basis point. 

For any k we have 

and therefore 

limply) 

: P(£n, y) 
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Taking the upper limit over k and using upper semicontinuity we see that 
lim p N (x,y) 



N 



< T p (a,a) : 



But the factor in square brackets cannot be larger than liniTv Pn(x, y) . Together 
with Tp(a, a) < 1 this implies 



lim p N (x, y) = T p (a, a)-lim p N (x, y). 



According to Remark |1V.6| with c(o) = limTv Pn(x, y) this means that a £ 5p. 



Now we know on the one hand that, 



lim p N (x, y) < T p (x, a) : Tp(a, y) 



and on the other hand that 

limjv Pn{x,v) > MkN Pn(x, a) : limjv Pn{^v)- 
The assumption p(a, a) = 1 guarantees that 



lim p N (x,a) = Tp(x,a) and lim p N (a,y) = TJa,y), 



and therefore 



lim p N {x,y) =Tp(x,ay-T p (a,y). 



□ 

The previous proposition shows again that the basis points of a definite pos- 
sibilistic system are decisive for its long-term behaviour. It is interesting to 
look for the meaning of basis points in a normal deterministically motivated 
system, i. e. according to Definition |111.1| and Definition [111.9| a system with 
p(x, y) = 1 if and only if y = F(x) where the map F : X — > X describes a 
deterministic system. 

We first recall some concepts from the theory of deterministic systems (see 
e-g-i). 
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Definition V.2 Let a deterministic discrete time dynamical system be defined 
by a continuous map F : X — > X on a metric space X . 

The set of non-wandering points for F, denoted by Vt(F), is defined as the 
set of points x G X for which the following statement is true: For every 
neighbourhood U of x and every T > there is at > T such that F t (U)nU ^ 0. 

A sequence (xj) of points in X is called an e—pseudoorbit for F if for all indices 
% 

d(F(xi-i),Xi) < e, 
where d(-,-) denotes the metric on X . 

The set of chain-recurrent points for F , denoted by 71(F), is defined as the set 
of points x G X for which the following statement is true: For every e > 
there is an e—pseudoorbit which starts and ends in x. 

On 71(F) the following equivalence relation, called chain equivalence ^niF), is 
defined: For x, y G 71(F) we have x ~n{F) V if for every e > there is an 
e—pseudoorbit from x to y and an e—pseudoorbit from y to x. The equivalence 
class containing x is denoted by [x\k(f)- 



Proposition V.3 Let a normal possibilistic system p : X x X — > E be moti- 
vated by a deterministic system F : X — > X (X compact, p upper semicontin- 
uous, F continuous) . Then we have 

tt(F) CR p C 71(F). 
Proof 

If x G $l(F) there are by definition a sequence (y n ) of points in X and a 
sequence (t n ) of integers such that y n — > x and F tn (y n ) — > x as n — > oo. 
We know that p(y n , F tn (y n )) = 1, and since p is normal, this means that 
Tp(y n , F tn (y n )) = 1, too. Upper semicontinuity leads to Tp(x,x) = 1, and 
therefore x G Ftp. 

The second inclusion can be shown in the following way: Suppose x G" 7Z(F). 
This means that there is an e > such that there is no e—pseudoorbit from x to 
x, or — in other words — that for every sequence (xj) <i<Ar with Xq — X jy — X 7 
N arbitrary, there is a j with < j < N such that d(F(xj),Xj +1 ) > e. But, 
because of upper semicontinuity of p, this can be reformulated to the statement 
that there is a c < 1 such that for every sequence (xj) <i<v with x = xjy = x, 
N arbitrary, there is a j with < j < N such that p(xj,Xj + \) < c. This 
implies Pn(x,x) < c for every iV and therefore Tp(x,x) < c, showing that 
x & Rp. □ 
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The arguments of the second part of the proof show that Tp(x, y) — 1 implies 
that for every e > there is an e— pseudoorbit starting in x and ending in y. If 
the reverse were true, this would mean that Rp = 7Z(F) and even [x)p = [x)k(f) 
for every x G 71(F). However, this equality does not hold in all situations, but 
in some important the next Propositions will show (see also p3| ). 



Proposition V.4 Let a normal possibilistic system p : X x X — > E be mo- 
tivated by a deterministic system F : X — > X (X compact, p upper semi- 
continuous, F continuous). If for every x > there is an e > such that 
every e— pseudoorbit (y t ) in [x]tc(.F) fulfills d(y t , F l (y)) < x for all t and some 
y G [x]n(F) (the so called shadowing property) then [x]h(f) = [x]p- 

Proof 

The conditions of the Proposition imply that for every x > and every x±, x 2 G 
71(F) with x\ ~k(F) %2 there is an orbit under F starting in y\ and leading 
to z\ with d(xi,yi) < x an( i d(x2,z±) < x, and an orbit starting in y 2 and 
leading to z 2 with d(x 2 ,y 2 ) < X an d d(xx,z 2 ) < x- Obviously, Tp(yi,zi) = 
1 and Tp(y 2 ,z 2 ) = 1. But upper semicontinuity then leads to Tp(xi,x 2 ) = 
Tp(x 2 ,Xi) = 1, showing that x 1 ~^ x 2 . □ 

Proposition V.5 Let a normal possibilistic system p : X x X — > E be moti- 
vated by a deterministic system F : X — > X (X compact, p upper semicontin- 
uous, F continuous). For A G X define c(A) = inf{p(y, z) : F(y), z G A}. Let 
x G 71(F) and c* be the supremum of all c G E with the following property: 
There is a p > and a cover U of [x\n{F) such that 

rw(^) > c 

where U p = {x G X : d(x, U) < p}. 
Ifc* = 1 then [x] n{F) = [x)p. 

Proof 

Suppose that c G E fulfills the above mentioned property with some p > and 
some cover U. If x\ ~n{F) x 2 there is a p— pseudoorbit (2/i)i<i<jv from x\ to 
x 2 . Set ji = 1 and define jk for k > 1 recursively in the following way: yj k -i 
is the last point of (yi)\<i<N whose image under F lies in Uk~i where Uk G W 
is the set which contains F(yj k ). 

This construction leads to a sequence (yj k )i<k<k "with ik = N (k < N). The 
sequence (yj k )i<k<k nas a ^ mos t one member in every U G U, and for all k 
with 1 < k < k the points yj k+1 and F(yj k ) lie in the same set U p . But this 
means according to the definition of c(U p ) that 

Tp(xi,x 2 ) > Pn c _ 1) (xi,x 2 ) > U UeU c(U p ) > c. 
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Taking the supremum over all c we see that Tp(xi,x 2 ) = 1. This and the 
analogous statement with reversed roles for x\ and x 2 leads to Xi ~ p x 2 . □ 

Corollary V.6 Let a-b = inf{a,6} ; and p be continuous. Then [x]tz(f) — 
for allxE 71(F). 

Proof 

Since p is normal, deterministically motivated, and continuous, for all c < 1 
there is a 5 > such that p(y, z) > c for all y,z G X with d(F(y), z) < 5. 

Set 8 = 3p and let IA be a cover of [xJ-^f) with sets of diameters smaller than 
p. Then for all y,z G U p we have d(y, z) < 3p = 5 and therefore c(U p ) > c. 
This is true for any U <EU, and so 

fi^p) = ^c(tfp)>c. 
As this construction works for all c < 1 we have c* = 1. □ 
Corollary V. 7 Lei (£",+, 6, = (1E~, max, — oo, +, 0) (see Example \II. 1 



(ivj\ ). Let the normal, deterministically motivated, continuous possibility den- 



sity p be of order r, i.e. there isaCEJE,C^0, and a 5* > such 
that 

p(x,y)>C[d(y,F(x))} r 
for all x, y G X with d(y, F(x)) < 5* . 

If the Hausdorff dimension of [x]n{F) is l ess than r, then [x]k(f) = Hp- 
Proof 

Recall that the fact that r is larger than the Hausdorff dimension of [xWjt) 
implies that the Hausdorff measure of [^^(f) i n dimension r is 0. This means 
that for every e > and for every 5 > there is a cover U of [x]-r/f) such that 
diam([/) < 6 for all U G U and 

]T [diam([/)] r < e. 

U&A 

Since p is of order r one can choose 5 = ^5* and thereby guarantee that if 
F(y),z G Us then 

p(x,y) > C[d(y,F(x))] r > C[dmm(U)Y\ 



and therefore c(Ug) > C[diam([/)] r . 
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Thus, for every e > and with the choice p = 5 we found a cover U of [x^f) 
such that 

E <U P ) > Ce. 
ueu 



But this is exactly the condition of Proposition [V.5| , formulated for (E, + , 0, : , 1) 
= (IE~, max, — oo, +, 0). □ 

We now look at stability in the context of possibilistic systems. 

Definition V.8 For a possibility density s(x) with values in an absorptive 
semiring, the set 

T s = {x G X : s(x) = 0} 
is called the set of impossible points, and the set 

% = {x E X : s(x) = 1} 
is called the set of totally possible points. 

Assume that in a possibilistic system at some time a certain set of states is 
regarded as totally possible whereas all other states are impossible. If for all 
future times the set of totally possible states does not change then this set has 
a stability property which we call possibilistic stability: 

Definition V.9 Let a possibilistic system be given by a transition possibility 
density p(x, y) with values in an absorptive semiring. A set A C X is called 
possibilistic stable if for all t G IN 

To* XA = A. 



Remark V.10 Definition [V.9| leads to a subdivision of equivalence classes [x]p 
into stable and non-stable classes of normal basis points. It is easy to see that a 
stable equivalence class is characterized by the following property: There is no 
y G [x]p and no z g" [x]p such that Tp(y, z) = 1. Still another characterisation 
of stable classes is the following: [x]p is stable iff T$ fx = [x]p. 

One can show that every possibilistic stable set includes at least one stable 
class of normal basis points. 
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Remark V.ll For the equivalence classes [xj^F) 01 chain recurrent points of 
a deterministic system F, stability can be defined in the following way: [x^f) 
is called stable if for all z G" [%)k(f) there is an e > such that no e-pseudoorbit 
leads from [x]tj(f) to z. Ruelle [24] calls a stable [xj-^F) an attractor of the 
deterministic system F. 

In cases in which for a deterministically motivated possibilistic system the 
classes [xWf) and [x]$ coincide, the two definitions of stability correspond. 



We sum up the findings of this section: In a deterministically motivated nor- 
mal possibilistic system the long term behaviour is governed by the normal 
basis points, which include the non-wandering points of the deterministic sys- 
tem and are contained in the set of chain-recurrent points. The stability of 
classes of normal basis points can be recognised by the shape of the maxima 
in the corresponding eigenfunctions of the pseudointegral operator which has 
the transition possibility as a kernel. These eigenfunctions can be calculated 
from the transitive closure of the transition possibility. The definition of stable 
classes of basis points is similar — and in certain cases equivalent — to Ru- 
elle's attractor definition. This shows that this attractor definition is robust 
to uncertainties which can be modelled possibilistically. 



VI Connections between possibilistic 
and stochastic systems 

Certain possibilistic systems can be used to obtain information about stochas- 
tic systems. As a first example we discuss the application of systems with tran- 
sition possibility densities in the semiring (E, + , 0, : , 1) = ([0, 1], max, 0, min, 1) 
(see Example |II.7||(iii)|) to stochastic systems in which the transition probabil- 
ities have compact support. 

More specifically, let (P^') be a family of transition probabilities on a com- 
pact metric state space X, depending continuously — in the topology of weak 
convergence — 0111 and on the parameter a G [0,1] such that 

supp P^ 01 ' C supp Pjf' strictly if a > (3 

for all x E X. 

Under the present conditions there is at least one family (S^*) of invariant 
measures of the stochastic systems P^> with a continuous dependence on a. 

Now define for all x, y G X 

p(x,y) = max{a : y G supp P^}- 
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Interpret these as transition possibility densities in the semiring (E, +, 6, : , 1) = 
([0, 1], max, 0, min, 1). 

Further define for all x G X 

s(x) = max{a : x G supp S^*}. 



Proposition VI. 1 With the notation introduced above, the function s is an 
invariant possibility density of the possibilistic system defined by p. 

Proof 

We start with the equation of invariance 



S (°)*(A) = f Pjf\A) S {a) *(dy), 



Ae A. 

So we can write 

s(x) = max{a : x G supp f P&>() S (a) *(dy)}. 

But x G supp f x P^(-) S^*(dy) iff there is at least one y G X such that 
x G supp p( a) and y G supp 5 (a) *. 

This means that a must be smaller or equal to the minimum of p(y, x) and 
s(y) for at least one y, and hence 

s(x) = max mm{s(y),p(y,x)} 
= J s(yy-p(y,x)"-dy 

□ 



Example VI. 2 An important special case of the situation described above is 
the case where for all x G X 

with a continuous function F : X — > X. The stochastic system can then be 
regarded as a stochastically perturbed deterministic system given by F. The 
transition a — > 1 describes vanishing noise strength. 
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A concrete example would be a dynamical system with additive noise, 

x t+ i = F(x t ) + (1 - a)&, 

where £ t are uncorrelated random variables distributed according to a proba- 
bility measure with compact support. 

The possibilistic system p is obviously deterministically motivated by F. 
Putting together the results of Section |V| and Corollary |V.6| we see from 



Proposition [VI. 1| that the limiting invariant measures are concentratec 



on classes of chain recurrent points — in agreement with other, more detailed 
results [||, [23[| . 



The support of the invariant measure in the case of non- vanishing noise strength 
e = 1 — a can be obtained from the corresponding eigenfunction s of Op as the 
level cut 

{x e X : s(x) > 1 - e}. 

A second way of connecting possibilistic systems to stochastic systems makes 
use of exponential estimates which belong to the so called "large deviation" 
method [[|, [!|. The famous large deviation principle can conveniently be ex- 
pressed in the language of possibility measures: 

Definition VI. 3 A family of probability measures (P^) £> o on a complete sep- 
arable metric space X is said to obey the large deviation principle with possibil- 
ity measure P with values on the semiring (E, +, 0, : , 1)= (IE - , max, — oo, +, 0) 
(see Example [77 7[ \( wJ ) if P has an upper semicontinuous possibility density p 
and if for all subsets A C X 

P(A°) < liminf e\ogP {e) (A) < limsupelogP (£) (A) < P(A) 
where A° is the interior of A and A its closure. 



Note that the fact that probability measures are normalised implies that the 
possibility measures appearing in the large deviation property must be normal. 
The negative of p is usually called rate function. A frequently imposed further 
condition is that the level cuts of p be compact. Since we are assuming a 
compact X anyway, this condition is fulfilled automatically here. 

If the rate function is continuous then we have because of compact X: 
\ime\ogP {£) (A) = P(A) 

for all open A G X. 

Many of the results obtained by large deviation methods have a suggestive 
formulation in possibilistic language. Here is an example: 
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Proposition VI. 4 (Varadhan's generalised Laplace method) Let (P^) have 
the large deviation property with possibility measure P. Let G : X — > IE" be a 
continuous function. Then 

lime log ^exp (^j^j P (£ \dx) = J ^G{x)"-P{dx). 

We now look at a family of stochastic dynamical systems whose transition 
probabilities have a large deviation property: 

Proposition VI. 5 Assume that a family (Pj e >) of transition probabilities on 
a compact state space X with continuous dependence on x G X has the large 
deviation property with transition possibility P x and that the possibility density 
is continuous. If there is a family (S^*) of invariant measures of the stochastic 
systems P^ that has the large deviation property with a possibility measure S* 
then S* is an invariant possibility of the possibilistic system defined by P x , i.e., 

S*(A)=1 P y (A)-S*(dy) 
for all open A G A. 



Remark VI. 6 This proposition is a simple consequence of the Laplace- Vara- 
dhan type approximation of integrals. However, it does by no means prove the 
fact that invariant measures for the stochastic systems actually have the large 
deviation property. Proofs of this property or similar estimates exist for a wide 
range of systems but require considerably more work |25| . They go back to 
the work of Wentzell and Freidlin || on random perturbations of dynamical 
systems, which is the continuous time analogue of what we are discussing here. 
From this background the negative of the possibility density s of S* has the 
name quasipotential. 

In the case where the stochastic systems are random perturbations of a de- 
terministic system F the corresponding possibilistic system is of course deter- 
ministically motivated by F. 



Quasipotentials have been discussed in the physical literature as nonequilib- 
rium generalisations of thermodynamic potentials (see for a review). The 
discrete time version || ||, |26| has been used successfully to investigate the in- 
fluence of noise on renormalisation schemes in the context of transitions from 



regular to chaotic behaviour p7| , and other universal aspects of the influence 
of noise on bifurcations 



2§. 



In the physical literature one usually finds heuristic derivations of quasipo- 
tentials instead of a strict application of the mathematical results from the 
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Wentzell-Freidlin tradition. These derivations use approximations of the La- 
place type, not unlike our motivation for Proposition |VI.5| . In this way, for the 



case of Gaussian noise, the following equation was found in |26[ for determining 
the quasipotential (— s): 



-s(y)) = min 



In our language of pseudomeasures this is the statement that s is an eigenfunc- 
tion of the pseudolinear operator 01, p(x, y) = — \{y — F(x)) 2 , with eigenvalue 
1 = — in agreement with Proposition |VI.5| . 

Applying the results of Section [TV] and Section |V|, one sees immediately several 
facts about quasipotentials which were so far only accessible by following the 
details of the proofs of the Wentzell-Freidlin approach, and not by the heuristic 
approaches. This refers in particular to the definition of basis classes, their 
importance for the construction of quasipotentials, and their relation to sets 
defined by properties of deterministic systems (like non-wandering sets, chain- 
recurrent sets, and attractors). 

The connection between quasipotentials and the possibilistic algebra brings 
another advantage, namely a systematic approach to the numerical compu- 
tation of quasipotentials. In such computations the eigenfunction problem 
is transformed into an iv-dimensional eigenvalue problem based on the semi- 
ring (IE - , max, — oo, +, 0) by discretising the space X into a finite space of 
N points. There are well-known and well-studied numerical algorithms for 
this finite dimensional problem (which is equivalent to the problem of finding 
shortest paths in a graph ||29|| ) . 



Remark VI. 7 Consider the eigenproblem for eigenvalue 1 on the semimodule 
(lE - )^ with operations + = max and : = + and definite transition possibilities 

Pif 



- ~N 



Interpreting — as the length of the arc (ij) in a directed graph, the compu- 
tation of an §j amounts to finding the shortest path (whose length then is -Sj) 
between a basis point and j. 

Following the pseudolinear formalism one can write down a general algorithm 
for solving the eigenproblem which is analogous to the Gauss-Seidel algorithm 
of linear algebra. The resulting algorithm is equivalent to Ford's algorithm 



30| for solving the shortest path problem . The computing time required for 



that algorithm is at most 0(N 3 ). 
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If p is not definite, the computation of the eigenfunctions has to be preceded 
by the computation of the eigenvalue A, which is the negative of the minimal 
cycle mean in graph theoretic language (see Remark [IV.24|) . An appropriate 



method is Karp's algorithm (see plj), again with a computing time of 0(N 3 ). 

These combinatorial matrix-type methods compete with certain iterative meth- 
ods which take a time of order 0(N 2 ) for each step of the iteration (see fl32|). 

However, if p is bounded above by 1 = (i.e., there are no arcs of negative 
length in the graph), there is a faster combinatorial algorithm, called Dijkstra's 
algorithm P3"| . Computing times are of order 0(N 2 ) in this case, so that the 
iterative methods mentioned above are no longer an attractive alternative. 

For a deterministically motivated problem it is possible to further reduce com- 
puting times by concentrating on those arcs (ij) for which the point with label 
j lies in a small neighbourhood of the deterministic image of the point with 
label i, and this algorithm appears to be the most efficient general method for 
the computation of quasipotentials. 



We know from Section [TV] that there are pseudolinearly independent invariant 
possibility densities for a normal possibilistic system as soon as there is more 
than one equivalence class of basis points. For this case we have to discuss, 
which pseudolinear combinations of invariant possibility densities qualify for 
being quasipotentials. 

Proposition VI. 8 Consider the situation of Proposition \ VI. 4 If P x has the 

possibility density p(x , y) then the invariant possibility density s characterising 
the large deviation property of (S^*) can be written as 

s(x) = / s(a) : TJa, xY-da 

J R s . 

v 

where is the union of stable classes. 

The values of s(a) for a G Rp have to fulfill the following equations: 

/ s(ayTp(a,bydb = / ^{by-TAb^ay-db 

for all a G Rl. 
Proof 

Since S^* is an invariant measure for the transition probability measures P!f\ 
we have for every A G A: 

Pj?Xdy)SV\da) = [ [ pV(da)SV*(dy). 



I A JX-A ' ' JA JX-A V 
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On the level of the corresponding possibility densities this reads: 



s(ayp(a, yX-dy = / s(yY-p(y, a)"-dy. 

X-A J X-A 

In this equation, p can be replaced by pN for any iV G IN, and therefore by Tp. 

We set A = l^x E X : Tp(a,x) < J R s_^.Tp(a,y) : dy^ where a G Rp. We see 

that the domain of pseudointegration on the left hand side can be replaced by 
Rp - [a]p. 

On the right hand side we insert 



which is a consequence of Proposition |IV.18| . Since y G X — A, the pseudoin- 
tegration can be restricted to Rp — [a]p, and we have 

/ K a ) :T iA a ^y) : dy = / s(b)^Tp(b, yY-db"-Tp{y, af-dy. 

Carrying out the pseudointegral over y we arrive at the stated relation between 
the coefficients s(a). □ 

Remark VI. 9 In the case that there is a finite number L of stable basis 
classes, Proposition |VI.8| gives L pseudolinear equations for the coefficient for 



the L independent eigenf unctions. However, only L — 1 of these equations are 
pseudolinearly independent. The coefficients are uniquely determined if we 
add the normalisation condition j x s(x) = 1 = 0. 

Freidlin and Wentzell describe a graph method for solving the condition from 



Proposition [VI. 8| . This is quite natural since the condition is similar to a 



Kirchhoff rule, for which graph methods have a long tradition. 

In the literature about quasipotentials (e.g. |34], ||) a connection to Hamil- 
tonian systems has been established and exploited. In the same spirit we 
formulate a connection between symplectic maps (see e.g. p5| ) and possi- 
bilistic systems evaluated on the semiring (1E~, max, — oo, +, 0). We briefly 
sketch some aspects of this connection; details can be found in the literature 
mentioned above. 

Let G : I x I ^ M, X C lR d , be a differentiable function such that the 
map q' i— > d\G(q, q') is a diffeomorphism for all q G X. Let G be a generating 
function for a symplectic map H : X x ]R d — > X x H d , (q,p) h- > (q',p'), i.e. 

p' = d 2 G(q,q') 
p = -d 1 G(q, q') 
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where <9j denotes differentiation with respect to the ith argument. Let II : 
X x ]R d ^Xbe the projection U(q,p) = q. 

Proposition VI. 10 Define a possibilistic system on X by a possibility density 
with values in (IE - , max, — oo, +, 0): 

p = -G 

where G is a generating function for the symplectic map H . 
If (g , • • • , <?a0 is a sequence of points in X for which 

PN(qo,QN) = Yl i=1 P(qi-i,qi) = 

1=1 

then it is the projection of the trajectory under H which starts in the point 

v = (g ,-9iG(g ,gi))-- Qi = n(^(f )). 

This follows directly from making use of differentiability in the maximisation 
required for the determination of p^. 

The determination of Tp(x, y) requires then a maximisation among all trajec- 
tories under H which start with a g-component x and end with a g-component 

y- 

The normal basis points of a definite possibilistic system are those recurrent 
points of the symplectic map along whose trajectories the sums of G(q, q') have 
the globally minimal value 0. 

If p is normal then the space {(q,p) '■ p = 0} is invariant under H. This 
follows from the fact that because of normality there is for each point q a 
point q' such that G(q, q') attains its minimum 0, which implies d2G(q, q') = 
and d\G(q,q') = 0. Note that the invertibility condition on d\G can only 
be fulfilled if the normal possibilistic system is deterministically motivated by 
a map F : X — > X. On {(q,p) : p = 0} the symplectic map reduces to 
H(q,0) = (F(g),0). The recurrent points corresponding to basis points have 
p = 0, too. 

Using the connection between p- values and derivatives of p one can write 

<9 2 Piv(go, Qn) = Pn 
where H N (v ) = (qN,PN)- Analogously, 

dip N (qo,qN) =Po 
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These equations can be used to determine eigenfunctions Tp(a, x) and Tp(x, a), 
a a basis point, by integrating the p- values along invariant manifolds ema- 
nating from the point (a, 0). Without going into the details of Lagrangian 
manifolds (see e.g. [36||) we mention that generically these invariant manifolds 



have tangling bends which lead to accumulating Maxwell points at which the 
eigenfunctions are not differentiable (see 0; many interesting aspects of this 
phenomenon have been studied in the case of quasipotentials for continuous 
time systems |37|, |38], |39|). 

The relation between symplectic maps and possibilistic systems suggests a 
potentially wide field of applications where idempotent pseudolinear algebra 
can be used in variational problems and Hamiltonian mechanics. 

An early example for such an application can be found in the method of effec- 
tive potentials for one- dimensional infinite chains of atoms (such as the Frenkel- 
Kontorova model), introduced by Chou and Griffiths ||16|| . This method can 
be translated into the language of uncertain dynamical systems: We ask for 
the possibility that the position of an atom at site t + 1 in the chain is Xt+i, 
knowing that the position of the atom at site t is x t . This possibility is assessed 
at a value —K{x u x t+ i) in the semiring (IE~, max, — oo, +, 0) where K(x t , x t+ i) 
is the energy which is added to the system when adding the atom number t+1 
at position x t+ i to a semi-infinite chain which ends with the t— th atom at 
position x t . 

In general, the possibilistic system defined in this way is not normal and not 
even definite, and therefore it does not have an invariant possibility density. 
But the semiring has an invertible pseudomultiplication and is radicable and 
absorptive, and if K is bounded, Proposition |i V.23| and Remark [1V.24| are 

1 N 

applicable. Thus, if A is the minimal cycle mean — }^ K(qj-i, (&) over cyclic 

sequences (qi, . . . , g^v) then k(x, y) = A — K(x, y) is definite, and 0~ has the 
eigenvalue 1 = whose eigenfunctions can be called conditionally invariant 
possibility densities in analogy to the notion of conditionally invariant measures 
of deterministic systems [ 4~0| , [411. From Section [IV| we know that the basis 



classes (Definitions [IV. 7 and IV. 10| ) for k play a crucial role in finding the 
conditionally invariant possibility densities. 

Interestingly, all the concepts introduced in order to describe the possibilistic 
system have useful interpretations in the original context of the underlying 
system of atoms: The eigenvalue A is the minimal energy per atom in the 
chain. The basis classes [a]^, a G R^, are the pure ground states of the chain. 
The conditionally invariant possibility density $fc a (x) = T^,(a,x), a G is 
an effective potential acting on the right-most atom with position x in a semi- 
infinite chain extending to the left, asymptotically approaching the ground 
state configuration [a]^. Similarly, ^k a {x) = T^(x,a) is an effective potential 
for the left-most atom in a semi-infinite chain extending to the right. The 
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two effective potentials &k a (x) and ^ a (x) can be used to compute excitation 
energies of defects, see [Jl6| . 

This last example shows that the concept of possibilistic dynamical systems 
can be useful not only as a method for dealing with uncertainties but beyond 
our initial motivation also as an approach to general variational problems. 
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